The Capacity and Attractor Basins of Associative Memory Models
نویسندگان
چکیده
The performance characteristics of five variants of the Hopfield network are examined. Two performance metrics are used: memory capacity, and a measure of the size of basins of attraction. We find that the post-training adjustment of processor thresholds has, at best, little or no effect on performance, and at worst a significant negative effect. The adoption of a local learning rule can, however, give rise to significant performance gains.
منابع مشابه
High Performance Associative Memory and Sign Constraints
The consequences of imposing a sign constraint on the standard Hopfield architecture associative memory model, trained using perceptron like learning rules, is examined. Such learning rules have been shown to have capacity of at most half of their unconstrained versions. This paper reports experimental investigations into the consequences of constraining the sign of the network weights in terms...
متن کاملMemetics and Neural Models of Conspiracy Theories
Conspiracy theories, or in general seriously distorted beliefs, are widespread. How and why are they formed in the brain is still more a matter of speculation rather than science. In this paper one plausible mechanisms is investigated: rapid freezing of high neuroplasticity (RFHN). Emotional arousal increases neuroplasticity and leads to creation of new pathways spreading neural activation. Usi...
متن کاملHigh Performance Associative Memories and Structured Weight Dilution
The consequences of two techniques for symmetrically diluting the weights of the standard Hopfield architecture associative memory model, trained using a non-Hebbian learning rule, are examined. This paper reports experimental investigations into the effect of dilution on factors such as: pattern stability and attractor performance. It is concluded that these networks maintain a reasonable leve...
متن کاملHigh Performance Associative Memory Models and Symmetric Connections
Two existing high capacity training rules for the standard Hopfield architecture associative memory are examined. Both rules, based on the perceptron learning rule produce asymmetric weight matrices, for which the simple dynamics (only point attractors) of a symmetric network can no longer be guaranteed. This paper examines the consequences of imposing a symmetry constraint in learning. The mea...
متن کاملMemory capacity of terminal attractor optical associative memory
The memory capacity of terminal attractor ( TA ) model associative memory is investigated based on the consistency between the stored pattern and the obtained equilibrium state in statistical thermodynamics. By the computer simulations, we give intuitive estimates of the memory capacity of the TA model associative memory. For the feasibility of the optical implementation of the TA associative m...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1999